Objectives

• Policy Simulator
  • Agents Flexibility
  • Model Flexibility
• Policy Optimization

The One Agent Problem

• Find the most profitable spot to fish
• Constraints:
  • No biomass information
  • Environment changes over time
• Subproblems:
  • How to explore
  • Explore-Exploit Tradeoff

Multiple Agents

• Other boats consume biomass
• You can use other boats information
• How to imitate?
• With probability \(p\) explore, with probability \(i\) ask a friend otherwise exploit

Many Agents

Oil Prices

What information they have and they act on

• Associate a choice with profits (per trip or per month)
• Compare and imitate profits
• Proceed by feedback and trial and error

Fish the Line (part 1)

Fish the Line (part 2)

Seventy-Thirty World

ITQ Prices

• Quotas are distributed 90% reds, 10% blue
• 

Blues are choke species

ITQ drives Gear (start)

ITQ drives Gear (end)

Gear fixes wastes

Optimization

The Future